Normalizing Empirically Underidentified Linear State-Space Models
نویسنده
چکیده
Normalizing latent-variable models in empirical work has sometimes more influence on statistical inference than commonly appreciated. In this paper, I show how relating non-identification to an invariance property of the likelihood function under certain groups of parameter transformations helps understanding the influence of normalization on inference and can guide the choice of identifying restrictions. In particular, I show that multimodal parameter estimator sampling and posterior distributions can result from poor normalization of countable groups of parameter transformations when a model is empirically underidentified. I also describe how group invariance affects parameter prior specification and how it can be exploited for improving the efficiency of optimization and posterior sampling algorithms.
منابع مشابه
Parameterization of multivariate random effects models for categorical data.
Alternative parameterizations and problems of identification and estimation of multivariate random effects models for categorical responses are investigated. The issues are illustrated in the context of the multivariate binomial logit-normal (BLN) model introduced by Coull and Agresti (2000, Biometrics 56, 73-80). We demonstrate that the BLN model is poorly identified unless proper restrictions...
متن کاملImproved Estimation of Normalizing Constants From Markov Chain Monte Carlo Output
Normalizing constants of conditional distributions include Bayesian marginal likelihoods and likelihoods of mixture models, such as hierarchical models and state-space time-series models. A promising method for estimating such quantities was proposed by Chib and Jeliazkov (CJ) and improved by Mira and Nicholls using bridge sampling results. Here three additional improvements and one theoretical...
متن کاملEstimating Ratios of Normalizing Constants Using Linked Importance Sampling
Abstract. Ratios of normalizing constants for two distributions are needed in both Bayesian statistics, where they are used to compare models, and in statistical physics, where they correspond to differences in free energy. Two approaches have long been used to estimate ratios of normalizing constants. The ‘simple importance sampling’ (SIS) or ‘free energy perturbation’ method uses a sample dra...
متن کاملA Linear Approach to the Control of Vortex Induced Vibrations of Circular Cylinders with a 2-D Van der Pol Model for Structural Oscillator
In the present paper, a new 2-D Van der Polstructural oscillator model is introduced for the vortex induced vibrations of circular cylinders.The main purpose of this task is to control the recently introduced model by means of modern control definitions in state space. In order to control the system, the whole model is linearized about its equilibrium point by deriving state-space matrices. The...
متن کاملA New High-order Takagi-Sugeno Fuzzy Model Based on Deformed Linear Models
Amongst possible choices for identifying complicated processes for prediction, simulation, and approximation applications, high-order Takagi-Sugeno (TS) fuzzy models are fitting tools. Although they can construct models with rather high complexity, they are not as interpretable as first-order TS fuzzy models. In this paper, we first propose to use Deformed Linear Models (DLMs) in consequence pa...
متن کامل